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ABSTRACT 

Observation statements are characterized as being: 
(11 dependent upon the human senses or other, sensory apparatus: (2) 
specific descriptions* (3) made by speakers who offer as the primary 
stffcftprt for their statements. *he events or things which stimulated 
therr making the statements: (U\ used as the foundations for 
knowledge; and (5) easily believed by experts in the field in 
question. Thirty criteria or principles for critically judging the 
reliability of such statements are presented .'First, observation 
statements are more reliable than the inferences based upon them. 
Second, Certain observer characteristics, affect reliability: 
emotionality; alertness; conflict of interest': skill with thing 
observed: theoretical understanding: normal senses; reputation: 
precision; skill with observation technique: and bias. Third, 
characteristics of the. observation condition affect reliability: 
instrument precision: quftlitv: condition: range bf application; 
ease of understanding. Finally, reliability of the, observation 
statement depends upon characteristics of the statement itself: 
commitment of speaker; corroboration or documentation; precision: fit 
into body of knowledge: and basis upon record. The statement should 
te made and believed by the observer, close to the time of 
observation. These criteria provide theoretical support f-or a test or 
curriculum on judging the -eliabilitv of observation statements. 
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^ THE DEPENDABILITY OK ^OBSERVATION STATEMENTS 1 




Iff V y 

Stephen Norris 
Illinois Rational Thinking Project 
Bureau of Educational Research 
University of Illinois at Urbana-Champaign 

Observation statements report the results 'of observations* Observa- 
tions play prominent jfblvs in many situations and in' many occupations* 
The" fol lo win g" ~su g ge st _ tlve c! ivefsity^f^sitiTations an cl~ occupations" "in wKicFT 
observations play a major part* In order to be an accomplished detective, 
Sherlock Holmes devoted jnuch effort to sharpening his powers of observa- 

tion. In attempting to determine the guilt or innocence of defendants, • 

o 

courts place much weight on the observations of eye-witnesses, ' In 

Attempting to teach students some things at>out the scientific method, 

science teachers often begin by telling their students that dependable 

3 

observation is part of the foundation of all scientific knowledge, 

*> * 

Because of the importance of observation in situations such as those 
mentioned above and in many other typps of situations, people are often 
called upon to decide whether to accept or to reject observation state- 
ments. In many of these situations, individual^ make correct decisions by 
using t(heir own experience as a guide. More systematic and general 
guidance than , that received from one's own experience is, however, not 
readily available* Such general and systematic guidance would rely upon 
the. accumulated experience of, human beingS in dealing with, situations in 
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which observation statements needed to bp judged. If such guidance were 
t available, it ought to be a useful aii- in correctly assessing observation 
statements. ■» J 

Guidance of this sort is available, but not readily so. Principles for 
judging- observation » statements Based upon centuries of judicial practice, 
scientific practice, and experience in everyday affairs are followed in many 
_fidds.__Jf_ahese_principles-were~s-y 8 temat-ized-,~they~could,- presumably,— 
form the basis for some school curriculum. Then, when faced with impor- 
tant decisions about the . acceptance or rejection of observation statements, 
the people taught would, have some critieria to apply in making sound 
judgments. - 

The major purpose of this pa,per is to present a systematic set of 
general principles for assessing observation statements. ,For man y ,of ' the 
principles I will illustrate their; application oy examining particular cases. I 
will Illustrate exceptions to the principles and urge that the effect each 
principle is to have on judgments in particular situations must be decided 
by taking into account the idiosyncrasies of those situations. Application 
of the principles requires* judgment arid flexibility. I will stress these 
requirements throughout the paper. 

ft 

; ; OBSERVATION STATEMENTS - 

' V 4 

In this section I will give some critieria which can serve as useful 
aids in distinguishing observation statements from other kinds of state,- 
ments. 4 I will begin by ( giving some examples of statements which I con- 

. f » 

sider to be observation statements. f l will then discuss the features of 

4 

those statement which could be used to identify them in this way. 5 



i In the following situations, as I am thinking of them, "the people 

i ' • \ : 

would b^f; making observation statements ♦ A child counts the number of 

lines in /a poem and says to her teacher, "This poem has fourteeen lines." 

Whi^e driving .^our car you look at the fuel gauge and say, "The tank is 

half full." Some lights go out in your house,. You check the fuse box 

and say, pointing to a particular fuse, "That fuse is blown." A physicist 

looks - at - an - am meter" on - her - labor atory -cft?sk-a nd~s ays— "The - current~in-the- 

wire is five amps." 

I say "as I am thinking of them" in the first sentence of . the last 

paragraph because if someone were to make certain assumptions about the 

t • 

situation's that I have not made, then that j^erson might judge correctly, 
given those assumptions, that the statements « are not observation state- 
ments. For example, in the blown-fuse situation, suppose tfhat you, the 
person who stated the firae is blown, had never before seen a blown fuse. 
Suppose, in addition , that the reasoning that preceded your statement 
went like this: "Most of the eight fuses in this box look very similar to 
each other. There is one fuse that does look different from the others 
though. The glass cover^ appears blackened by some substance. Also,* 

there is no silver wire inside this fuse but there is one inside each of the 

i 

others*" In such a case, according to the manner in which I want ^to use 
the term 'observation statement 1 , your statement that the fuse is blown 
would noi be an observation statement but gather an inference based upon 
the statements that were made prior to it. These prior statements would 
be observation statements*. 

To illustrate how one might decide which of the above statements are 

■ - i. 

observation statements 1 will discuss some of the characteristics of obser- 
vation statemerfts, as I conceive of them, which distinguish them from 



other ty (Ws of statements. 6 As I will show, to distinguish a statement as 
an observation statement requires taking into consideration each of the 
characteristic* which I will discuss as well as the features of the situation 
in which the statement was made. 

In ^he s-ituations in which they are made, observation statements are 
characterized by: * 

>— A being-closely-dependent-upon-the-human-senses-or-other-sensory- 

• „ apparatus. • > 

By "other s«M !: ;ory apparatus" I am referring to such devices as ther- 
mometers, tire pressure gauges, light meters on cameras, and sound inten- 
sity meters, which are^often used to make observations that could not be 
made \^th the'' human senses alone. Such devices are often called "exten- 
sions to the senses", a description which suggests that. their function in 
making observations is similar to that of the human senses. 

Characteristic A is, I believe, an essential characteristic of observa- 
tion ' statements. In the situations in which I have imagined the following 
statements being made, they would^not be observation statements because 
they do not depend closely upon the senses: "One should not make prom- 
ises one does not intend to keep"; "The square root of nine is three"; and 

yWater freezes at /.< ro degrees Celsius. * 

One might 'be able to imagine situations different from the ones I have 
imagined in which the above statements would be closely dependent upon 

. the senses. For example, Suppose a person did not know^that defini- 
tion the freezing poiot of water is zero degrees Celsius. Such a person 
might set out to determine the temperature at which water freezes by 
measuring* the temperature with .a thermometer. If' a person cooled some, 
water until it began to freeze, read the thermometer immersed in it, and 

concluded from the temperature, "Water freezers a.t zero degrees! celsius", 



then thaif statement would be closely dependent upon the senses of th<* 

speaker in this situation, and would thus possess the essentia! charac- 

} 

terlstic A of observation statements. Judging whether the 'statement is 
indeed an observation statement would require taking other characteristics, 
which I will discuss presently, into account. My intention in considering 
this hypothetical cafe is to emphasize what I have previously stated: 
-j uci H>»K-correctly-whether-o^ 

usually requires one to take into consideration the features of the situation 

. 7 . . 

lp just ( 

( 

Tempera 



in which the statement was made . In the example just discussed the 



speaker's background knowledge about the Celsius Temperature scale is a 
feature of 'the situation to take into account in jn,dging whether the state- 
ment is an observation statement. I say "usually" in the underlined part 
of the sentence above because I carlnot imagine any situation having fea-* 
titles suc\ that certain statement s wowld t>e observation statements. Here 
is an example of such a statement: "One should not make promises one 

does not intend to keep." I cannot ima^ne any situation in which that 

I 

statement would t>e an observation statement. The discussion which follows 
of characteristic B should make clear the reasons why I cannot imagine 
j-this. The statement does not have characteristic B, In fact, the- other 

two Statement s, "The square root of nine is three" and "Water freezes at 

y , 
zero degrees celsius", also do not have characteristic B. 

Some people might also be puzzled about fohat is actually being ot>- 

- . \ 

t 

served when some sensory device other than one of the human senses is 
used to make an observation-® For example, if a thermometer is used to 
measure the temperature of water, a person might claim that what is being 
observed when, someone reads the thermometer is the height of the column 



of liquid in the thermometer and not the temperature of the water. The • 
critic might then conclude that the statement "The water is ten degrees 

■ 

celsius" would not be an observation statement in such a; situation. 
Rather, it would be a conclusion based upon the observation statement 
"The column of liquid has risen as far as ten on the scale." Since some of 
, the characteristics of observation statements which I have yet to treat will 
help m e deal with this problem more eff ectivel y, I w ill defer discussing it 



until I have discussed those .characteristics" 



i 



. In the situations in which they are made, observation statements are 
characterized by: . 

B. being descriptions of some specific things that have happened or 
the states in, which some specific things are. 

The following statements have characteristic B in the situations in 

♦ 

which they are made." You measure the air pressure in the tires of your 
car and say, "The air pressure, in the right rear/tire is twenty-five' 
pounds per square inch." A student is conducting a chemjstry experiment 
and is watching what happens as he or she adds one liquid to another. 

4 

The student says, "The colour of the mixture just turned pink." A me- 
chanic has examined your car and says to you, "The flexible hose leading 
to one of your car's brakes has deep cracks in it." A psychologist gives 
a person an IQ test, scores the test . and says, "The person received a 
score of 96 or^the test."* 

Characteristic B limits the form that observation statements can take. 

» 

Statements whici^ an- not descriptions of some specific state of affairs in 
the world are disqualified fr^om being observation statements. For exam- 
pie, 1 cannot imagine a situation in which the statement "All matter is ■ 
composed of atoms" would be used to describe some specific thing. 
Rather, it describes some things in general; all pieces of matter.' Thus, it' 



7 



r 

i« * .... ... 

is not ah observation statement. As another example, the statement "Kil- 

lina is wrong" would not be an observation statement in any situaton in 

... 

which I can imagine it being made. I cannot conceive its being used to 
describe something. x 
A statement's having characteristic B, or any other of the character- 
istics of observation statements that I discuss i* this paper, does not 

- . f+ 

~~gT3 a r an tee""f Hat" f Ke"~st~a"t ^m e n t "is~ an observatior\ statement! The~~fol lowing ~~ 
example illustrates this fact. In the example I give a statement that has 
characteristic 15 and show that it is not necessarily 'an observation state- 
ment. Suppose I make the following statement: "The LiflVaijy of Congress' 
has a copy of The^ncyclopaedia Britannica . " If I made that statement at 
the time I am writing this paper, it might be a true statement. I suspect 
that if is. If it is true, it describes the way some specific thing is; it ^ 
says that a specific library has a copy of" a particular publication. It is 
not an observation statement, however. . I have never been to the Library 
of Congress up to the time of writing this paper and have had no. other 
means of observing the books on that library's shelves. In ad-dition, no 
one has told me that he or she has seen a copy of the Britannica on the 
sheivfcs of the Library of Congress. So, I would not even be giving a 
secondhand observation statement* by reporting an observation that spmeo'ne 
else has made. What I would be doing is inferring from what I know about 
the holdings of the Library of Congress tk^t the library would have a 
copy of such a famous publication as the Britan nfca . In short, my state- 
ment would not have characteristic A. ■ 

One cannot decide- with confidence on the basis of a statement's 

y 

having, any one of the characteristics that I discuss that the statement is 
an observation statement. The example just discussed illustrates the 
soundness of this caution. 



■ ' - • — ' 

In the situations in which they are made, observation statements are 
characterized by:' l ' s ' 

3 ' 

C. being made by speakers who offer as the primary 'support for 

the statements the events or things which stimulated their mak- 
ing ^tke statements in the first place. 

This characteristic illustrates •Jftat observation statements* are ^asic to 

our knowled-ge of the world. When people make observation statements 

"fh^y^njjTu^ 

statements are based. For example, the driver* of a car usually does not 
go through a line of reasoning leading up to the statement, "There are 
several gallons of gas in the tank." She merely looks at the fuel gauge 
and utters $ie statement based upon v^hat she observes. If, asked* by a 

- v ■ \ .,. , 

passenger how she knows that there are several gallons of jjfas in the tank, 

the most appropriate resjx^nse the driver can make in most circumstances 

is # to point to the fuel gauge, that is, to ask the passenger to make< the 

observation himself. If the passenger is not then convinced that there are 

several gallons o,f gas iij the tank T>ut persists in his questioning, it is 

likely in usual circumstances t'hat the driver will not know how to respond 

further. The strongest support she has for her statement that the^ tank is 

half full is the position of the fuel gauge, the thing which stimulated her 

to say that there are several gallons of gas in the tank. If-- the passenger 

is not satisfied with this support, the driver might see no other approach 

that could work. • 

♦ 

. The discussion of the previous example assumes that the driver and 
pas'senger know the meaning o"f various positions of the fuel gauge needle. 
For most people in our society these are reasonable assumptions, I believed 

* 

That* is why\ said, "in most circumstances" and "in usual circumstances" 
in the last paragraph. If the passenger persists in his questioning after 
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he has been shown the fuel gauge, the driver might become puzzled be- 
cause h^e assumes the passenger knows what the gauge reading rr^eans. 
Faced with this puzzle the' driver might think either that the fjassenger 
does not knoy/ the meaning of the fuel gauge reading or that tlie passen- , 
ger is trying to be contentious.. If he thinks thePfirsft of these, that the 
passenger does not know the meaning of the fuel gauge reading, the 
-driver-might- try- to~exp lain - to~thc~pass(>n^eT""h"o\v tire - gauge ^^rlc^ancl — 

what various readings moan. The statement "There are several gallons 6f 

» 

gas in, the tank" would for such a passenger be one t^hat needs to be ' 

supported by other statements which show how the gauge r Jading is linked 

to the amount of fuel in the tank. Vor this passenger the statement would 

i 

not be an observation statement. For this ( passenger the primary means of 
supporting the statement is not only to point to the fuel gauge but also to 
give a line of reasoning which connects the gauge reading to the amount of 
fuel in the tank. Hence, for this passenger the statement is not charac- 
terized by characteristic C, 

The abovQ example shows that the knowledge of the speaker Vho 
makes a statement is one of the factors that determines whether that 
statement is an observation statement. For physicists fhe statement "The 
current in the wipe is five amps" is usually an observation statement. 



Physicists 1 traihing makes them thoroughly familiar with the electrical terms 
'current 1 and 'amps' and with the application of these terms. Because of 
this familiarity, among physicists 'the primary support usually given for 
the above' statement is the reading on the dtal.of an ammeter, that i3, the 
phenomenon- which stimulates the making of the statement. ; However, 
among people not knowledgeable in the terms used to describe electrical 
phenomena statements atfout the amount of current flowing in wires are not 



u 



Observation statements. For those people the primary support for such 
statements is not the phenomena which wouldytlmulate a physicist ' to make 
the statements. For people run knowledgeable in the ' field' such . phenomena 
would not be recognized as sup port . VFor them support woukl have to ' 
include a list of statements which j/vtj the meaning of the technical terms 
used and which show how the tfnenomona observed is connected to the 
— statement- made.' -— . 

Ae^a rule of thumb /tc, get an idea- whether or not "a statement has 
characteristic C ask th/ person _ who; made the statement the following, 'qUes- 
tion: "How do yoX know?" ,fo* example, -to .^.w^f^e staSment'j 

x ■ ■ »-• ••' - ■'• - ... • - 

"The *use is Mown" has Characteristic £ ask % s^l^ ho V . he.-6V sfo 
knows tpdt The, fuse is blown. If i n artswer to your questfon.the spe*^. 

„ shows you the blown fuse or says that he or she personally saw that tl^ 
f^se is blown, then it is likely the statement has characteristic C. If the 
speaker says something like: "Well tire lights in the living roan would not ' 

^work. A note on the fuse box says which fuse controls the living room. 
Therefore...", then the statement "The fuse is blown" probably does not 
"have characteristic ' C. - \ 

In the situations in which they" are made observation' statements are 
characterized by: V 

D. being used asj^founcjatiohs for knowledge in those fields in 
which theva-fe observation statements." 

This characteristic is closely related to characteristic C. Character- ■ 
istic C says that observation statements do not receive their prime support 
>in the context in which they are "made by appeal to other statements. 
Rather, they receive their prime support by appeal to the phenomena they 
describe. 1 Characteristic D says that observation statements are offered as 
the basic support in particular fields for statements other than observation 



'statements which constitute tpe ' knu^lJIlgc in those^fieltls. They are able 

to. be offered as basic suaiport because the^y have; characteristic O. : 

, • »* . « 

Consider the following example. Statemertts ibout the tehdencies of 

- • . , • * • v ? * * * ■ • ... 

certain types of ptfople t<> behave in certain ways make up a large part of 
the knowledge of ^sychojogy. A ^psychologist might offer a piece of this 
knowledge by stating the following !! IQ scores* correlate h ighly with school 
achievement scores. " The psychologist's statement is not an observation 



statement because it lacks some of the charactersitics of observation state- 
mehts* in particular characterisitics B- and C. However, it is based on 
observation statements.^ Observation statements like the following might be 
ustfd to support i\: "John Doe got 120 on the Wechsler IQ test, and had a , 
4.0 G PA " and "Jane Doe got 135 on the Wechster IQ test and had a 4.75 
GPA." If asked to support' these latter statements, the psychologist would 
likely appeal to the phenomena that the statements describe. The psycholo- 
gist might prodtuce John's and. Jane's answer sheets, for example. It is 
unlikely that r the psychologist would appeal to other statements in support. 
The psychol'gist's means of supporting^flTe statements #bout John and Jane 
Doe. illustrates that these statements have characteristic C. The whole 
example illustrates that the? statements about John &nd Jane, having., char- 
acteristic C, can be used so that theyr have characteristic D. 

The pbint is that the psychologist does not consider anything more 
basic to the support o( his or 'her generalization about IQ and -achievement 
than 'his or her observations. A critic of this view might suggest that the 
ps ychologis t might use some theoretical considerations to support his or 
her generalization. For example, the psychologist might say the generali- 
zation reached is that which one might expfect based upon certain theories 
of human nature. But then these theories themselves would have observa- 
tion statements as part of their foundational support. < 



f 
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You can always ask the question "How do you know?" to? a scientist 
who. has made som? statement. Often that scientist will be able to suppprt 
hia or her statement with some other statement upon which the first srta<e- 
, me Rj depends {or »ts support. However; if you then ask the scientist to 
m support the statement he or she has offered in support and continue totdo 
this for every statement given in support of other statements, you will 

eventually re ach statements for which tho scientist will merely point to 

some phenomena for their support. Those statements which are not sup- 
ported by other statements are observation statements and serve as. part -of 
the foundations or basic support for the other statements in the field in 
question. 

In the situations in which they are made observation statements are 
characterized by: v , . 

E.. the fact that people knowledgeajWe in the field in question who 
have made the same observation^ill quickly agree that the 
statement is true. ^ v 

The qualification .,thaV^the people making the observation be know- 
ledgeable in the field in question is important one. Consider the fol- 
lowing case where the two individuals doing the observing are not both 
knowledgeable in the area of concern. Suppose that one of the individuals 
is an economist. ^Suppose the other is not an economist and knows very 
liitle economic theory and very little of the language economists use to 
repcyrt their observations^ Both individuals are examining the same .piece 
of paper which reports on the day's economic business. The economist re- 
ports, her observations in the following statement: "All major economic 
indicators showed ; a decline today." The person who is not an economist 
cannot agree or disagree with the statement because, having no economic 
training, he does not even know what the statement means. However, had 
another economist, been present and had that other economist observed the 



flame thing' as the first economist, then, that other e^ohomist would have 

* * » 

quickly agreed with the report of the first economist . 

Similar situations to the economic one described a^6v6 occur ambng 
people who have ho Specialized training at all. Consider the case of a 
parent speaking to his child who has not yet mastered the use of much of 
the language. Suppose the child uses a few nouns to identify things but 

has -not— ye t- learned— to- -identif y— colours* The— parent -says— to— the ) eh ildi — 

while pointing to an apple which they both can see, "The apple is red." 
The fact that the child is not able to d£> ree or; disagree with the statement 
her parent has made does not, in this situation, count against the state- 
ment being an observation statement for the parent. The child, not hav- 
ing mastered the use of the word 'red 1 , cannot be expec/ed to agree 6r 
disagree with the statement. However, most people who have mastered the 
use of the language could assent quickly to the parent's statement, if the 
""statement was correct, that is. Thus the statement would usually have 
characteristic E. 

At this point I am able to more completely discuss the example which 
was left dangling in the section treating characteristic A. In the example 
in question, I raised the problem of whether the statement "The* water is 
ten degrees Celsius" is an observation statement or whether it ip an infer- 

V * 

ence based u[jon the observation statement "The column of liquid in the 
thermometer F^s risen to the line marked 10°. " The problem can be 
t reated by cocrsidering characteristics C , D and E of observation state- 
ments. These characteristics focus one's attention respectively on that 
which the speaker considers support for the statement, on the function of 
the statement in the field of knowledge to which it belongs , and on how 
other speakers might view the statement. The statement "The water is ten 
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degrees ceLsiua" when made in nSa/y , if not Wst, contexts among accom- 
plished speakers of tfce English /anguage' possesses each of these three ' 
characteristics. 

If a crftic insisted that/the statement' about the water temperature 
really is an inference b^safl 'upon the,*statement about the position of the 
liquid in the therrnometej/, , you mig ht agree that it might be an inference, 
-r-he-critic-might-say-th^^^ 



person could not be said to observe water ,temperatu re but only the height 
of a column of liquid. If this is the .sense of the word intended by the 
critic one might ask him or her whether\one can really observe a column of 
liquid or merely a column of somthing red inside a glass tub. Or one 
might ask the critic, whether one can really observe something red inside 
the tube or merely some red light which appears to be emitted from some- 
thing inside the tube. Maybe the critic wouLd want to limit even more 
severely the things we really observe. But, 1 believe, one might v ask the 
critic what the point is in limiting in this manner the objects we can be 
said to observe. In my dealings with thermometers that I can recall, the 
people with whom I have dealt have nqt been interested in the appearance 
of red light being err|tted from something inside a glass tube or in the 
Jieight of a red column of liquid. These people at least have not spoken 
of red columns of liquict or of the appearance of red light. They fiave 
spoken of the temperature of the substance the thermometer was indicat- 
ing. I believe there is a point to usifrg 'observe' a way which allows 
one to say t hat people observe the temperature of something in reading 
thermometers. Part of th$ point is that I wish my analysis to directly 
apply to the way people usually speak. The statements people usually 
make when reading thermometers are statements about the temperature of 



•something X}ot about the. height of a column of liquki. In addition,, stater 

. \ - 
mehts about x temperature nead from thermometers usually have special 

status ^n oijr language,, compared to statements about the height of the 

liquid column in thermometers. Statements about temperature, and not 

statements about the height of columns of liquid, are the statements which 

are usually uwed to decide upon courses of action. For example, if onfe 

wants to go" swimming or m a ke yog urt one uses i n formati on on th e tempera- 

tare of the water not on the height of a coftimn of liquid to govern one's 

actions. 

However, one can imagine situations in which a statement about the 
height of the column of liquid in a thermometer might be a mor$ appropri- 
ately called an observation statement than a statement about temperature. 

following are examples of such situations. A person is checking the 

i ■ ■ . 

accuracy of a newly constructed thermometer usfrig a thermometer having a, 

certain accepted accuracy. In such a case, the person migh<t reasonably 

focus oil the heights to which the liquid rises in each thermometer and 

make observation statements about tjie heights observed. For the courses 

4 

of action the person will make based-on his observations, speaking of the 

' / ' • 

height of the liquid columns is a perfectl y appropriate way of speaking . 

4 ^ 

There may ^lso be special reasons for a person's^reporting his ol^ser- 
vation in terms of^the height of the Hquid column rather than in terms of 
temperature. Saying that the liquid has reached -a certain height commits 
the speaker to holding fewer things to be so than saying that the teVnper- 
ature of the substance is such-and-such. In a situation of reading a 

■ 7 ' 

thermometer , sa ying the tempera ture of a sufostAnce is such-and-such 

commits one to holding two things true : ( i) the temperature of the sub- 

> ■ ■ ■ > 

* 

stance is such-and-such and (ii) the height of the liquid in the ther- 
mometer corresponds to that temperature. Saying that the liquid in the* 
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thermometer has, reached a certain height docs not cotnmil one to holding 



(i) above. One can be fairly certain that Yha thermometer te inaccurate to 
some degre^. Hefice, the thermometer reading will not correspond pre- 
cisely to the temperature of the substance being measured., hi a situation 
in which- knowing the temperature /to a moronic curate degree than is pos- 
sib 1^ using the thermometer available is desirable, -one might speak. of the 
height of the liquid column to- avoid deciding on courses^of action based on 



' / 



inadequate information. In surh a -situation, it might be useful to think of 



statements about temperature to be dependent upon statements about the 
height of the liquid columns. In such a situation the statements about 
temperature would riot have characteristics C and D and thus would not be 
observation statements. ' 

Statements that have the Jive characteristics I have described haVe a 
special ^status in our 'language. Such statements are among the most 
reliable statements thai wo make about the world. They tend to provide 
reliable guides to. action. lAlso, because obser vatitilh statements so picked 
out serve^as the basfs for much of our other knowledge, the reliability of ^ 

• this other knowledge tends to be limited by the reliability of these state- 
ments. A statement, in most cases, ^ cannot be more reliable than the 
statements upon which it is. based. Because of the* limiting effect the 

• reliability of observation statements has on the reliability of other state- 
ments upon which we -depend, concentrating on increasing the reliability of 
observation statements, and also concentrating on the- nature of observa- \ 
tion statements, is an important and useful thing to do. 

/> 

In summary, the distinction I wish to draw between observation 

v ' v 

Statements and other kinds of statements can be made only by attending to 
many of the features of the situations in whjfch the statements are .rqa.de. 



is 



^ ' ' it 

The -fl«?p»endertce of the statements upon the senses* the descriptiveness of 

the statements, thtl speakers 1 background knowletfge , the function of the 

statements as the basin of other statements , and the degree to which t 

statements draw quick assent .^re features which must be considered, 

> ^ ■ 

Distinguishing, in this^way certain statements as observation statements is 

v- 

* f - ' 

useful because doing so in part icular' situations often points to the state- 

riieht$_in ..those_situ atjons— whic h_are— the_thost_r.eliable This-last-charatter- 

istic of observation statements, their reliability, will be the focus of a 

large part of the remainder of this paper. 

The following characteristics of observation statements which I have 

discussed in this sectiot) are, useful in distinguishing then) fron^ other 

types of statements, ■„ In the situations in which they are made, obsorv'a- 

tion statements, are characterized: 

A. by being close! dependant upon the human sense^or other 

7 > 'A : 



sensory apparatus; ' ~ 

*» 

B. by being descriptions of some specific things that h^ve hap- 
j peneck or the states in which some specific things are; 

C. by being made by speakers who offer as "the primary support 
for the statements the events or things which stimulated their 
marking the statements in the first place; t 

D. by being used as the foundations for knowledge in those fields 
in wT^ich they are observation statements; 

and E. by the fact that people knowledgeable in the field in question 
who Tiave made the same observations will quickly agree that tfie 
statements are true. 
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• PRINCIPLES l'6'R JUDGING THE • 

RELIABILITY OF OBSERVATION {STATEMENTS 

The list df principles which I present here is based upon a list prer 

1 2 •* 

sented by Robert Ennis, ' Both Ennis and I ihtend the' principles to be 
guides in judging the reliability -of observation statements. They can be 
thought qf as factory to consider in making a judgment of reliability. 
T.h_e_prjn.ciples_c_QJ)cern_t.wo_main . .topics .: (i)_the._ comparative, reliabil- 
ity of observation statements and inferences based upon them, and (ii) 



factors affecting the reliability of observation statements. The principles 
dealing with the factors affecting the reliability of observfifion statements 

concern three main areas ; the observer, the observation conditions, and 

*. 

the observation statement. 

t 1 • 

* * 4 

Here are the principles: 

4 To^>ic I . The comparative Reliability of observation statements and 
^ inferences based upon them 



1.1 Observation statements tend to be more reliable than 
* inferences based upon them. 

i 

Topic 11 . Factors affecting the reliability of observation statements 

Area 11.1 An observation statement tends to be reliable to 

the extent thjttttHje observer: 

II. I. 1 does not allow his or her emotions to interfere 
with his or her making sound judgments; 

II. 1.2 is alert to the situation and gives his ov her 
statement careful consideration; ' 

II. 1.3 has no conflict of interest; 

II. 1.4 is skilled at observing the sort of thing 
observed; 

II. 1.5 has a theoretical understanding^ 'the thing 
observed ; 
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11.1.6 has senses that function normally;' 

ILL? has a reputationyfor being honest and correct.; 

lLl.8 uses as precise a technique ^s is appropriate; 

ILL9 is skilled in the % techAjque being used; 

and ILL10 has^no preconceived notions about the way 
th'e observation, will turn out; ^ 

Area IL2 and to the extent that the observation conditions: 

H— 2 — 1— pro vi de~a — s a t is fa c tor y mod ium o f ^frserva t "ion"; 

and 11.2.2 give the observer good access to the thing 
observed. 

(If in gaining access some instrument' is used, 
then the statement tends to be reliable to the 
^ extent that the instrument: 

11.2. 2a has suitable precision; 

II. 2. 2b has a suitable range of application; 

IL2.2c is of good quality; 

' IL2.2d works in a way that is well understood; 

and IL2.2e .is in good working condition,) 

Area IL3 and to the extent that the observation statement: 

11. 3.1 commits the, speaker to holding a small number 
of things to be true; • J 

11.3.2 is corroborated; ' ', 

II. 3. 3 is no more precise than-can be justified by 
the observation* technique being used; # / 

II. 3.4 is made close to the time of the observation; 
♦ * 

II. 3. 5 is made by the person who made the observa- 
tion; 

11.3,6 is strongly believed to be corroboratable by 
the person making it; 

IL3.7 does not conflict with other statements for which 
good reasons can be given; 
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and 11,3,8 -is- based upon -a- reliable record ,* if it is based 
pn a record* 

(If it is based upon \a retord, then'the state- 
meat tends to Jbe reliable to the extent that 
/ the record: 

it, 3.8a was made close ty the timWj^f the 
observation ; f 

II. 3.8b was made by the person who made 
the observation; jj[ 



II, 3,8c comes from a source having, a good ( 
reputation for making correct 
records ; ' 

I and IK3.8d is believed by the person making the 

statement to be correct*) 



Two aspects of the wording of the principles needs to be explained. I 
used "tehds to be reliable" and "tend to be more reliable" because al- 
though the principles'* are very genef*al they do have exceptions, For 
example, although observation statements tend to be more reliable than 
inferences based upon them, they are not always more reliable. The fol~ 
lowing is an 'example in which the inference is more reliable than the 
observation statement upon^whic^h it is based. Suppose that after the 
ballots had been counted in the election of the mayor for a certain small 
town having 250 eligible voters the number of votes received by each 
can didate was reported in the following observation statements by the 
person who had counted them: "Candidate A received 176 votes" and 
"Candidate received* 62 votes." Based upon these statements the follow- 
ing is inferred: "Candidate A received the majority of the votes cast." I 
believe that the inference in this case is more reliable than either of the 
observation statements upon which it is based, I am led to this belief by 
my knowledge of the running of elections* It is not uncommon in elections 
for the counting of ballots > to be slightly inaccurate. This is the reason 
for candidates' asking fo^ recounts when the reported results are elbse. 



While 'close 1 is a loose word In th; it does not refer to any particular > 
number, experience in the counting of ballots fjives some guides in apply- 
ing the word in particular situations. In the situation I haj/e imagined the 
results differ by about 50% of the votes cast. This would not be consid- 
ered a close election. It would be extremely unusual for a ballot count to 
be mistaken by such a large percentage. The inferer/ce that Candidate A 
_ r_e c e i v_e.d _t h e_ m a j o r i t y__o f _ _t h e _v_o.t e s _N\.o.uld_no.t_likel.y_cFyange__if_there_was_a 
recount. However, the actual vote counts might change by a small amount. 
Thus the inference is less likely to require change on the basis of a 
recount than the reports upon which it is based. Therefore, the .inference 
is more reliable than those reports. 

Another aspect of the wording of the principles that needs to be ex- 
plained is my use of the conjunction 'and*. Under the topic "Factors 
affecting the reliability of observation statements" the principles within 

each of the three areas are conjoined using 'and 1 . Also the three areas 

t 

are conjoined using 'and 1 . The reason for doing this is that Individ ual 
principles T>r areas of principles cannot be considered by themselves as the 
basis for making a decision about a statement's reliability as if the list of 
principles is intended to suggest a set of necessary or sufficient conditions 
that must be met for a statement to be reliable. Instead, for each deci- 
sion , the ' entire combination of factors suggested by the principles and 
one's knowledge \of the situation and experience in similar stiuations must 
be considered and weighed. For example, a reliable observation statement 
can be made even though thj) observer did ^not use precise techniques. 
Thus, using precise techniques is not necessary for a statement to be 
reliable. On the other hand an observation statement can be unreliable 
even though the observer used precise techniques. Thus, using precise 
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techniques is not. sufficient, by i t »«>! f , to make a statement reliable* Also, 
one's knowledge of the/situation and similar situations, such as on«e's know- 
ledge of how to interpret the word 'close 1 in the election example, must be 
used in addition to one's knowledge* of the principles* 

The following example illustrate^ that deciding upon Itie reliability of 
statement based upon one principle can lead to mistakes. It also illus- 
trate s__t_ha_t_ ex pe.rien jc _e_in_ _the_t.y_ p_e^_ of_silu_a t io_n _ being c onsi dered is required . 

A novice technician measures the length of a brass cylinder using an 
expensive, precision caliper. The instrument is designed to give 
accurate readings over a wide range of temperatures. The present 
tempera ture is well within these limits. The novice has just been 
instructed in the use of the instrument and has not yet mastered the 
technique. He states his reading* "The cylinder measures 6,023cm, " 
His instructor uses a steel ruler to^ cl>eck the instrument. The ruler 
is not designed to be as accurate as the caliper. She says, "The 
cylinder's length is between 6.03cm and 6,04cm," * 

In this situation the novice's using- a precise technique to make his 
observation counts in favor of the reliability of his statement. His being a 
novice, and'.tfius h person lacking in experience, counts against the re- 
liability of his statement. Counting: in favor* of the reliability qf thje in- 
structor's statement is thre,fact that she is experienced in making the sort 
of observation involved. Counting against the reliability of her statement 
is the fact that her technique was not as precise as the one used by the 
novice. 

The situation is typical of most situations in which judgments of reli- 
ability need to be made. It is one in which different principles suggest 
conflicting judgments. If onev followed the principle concerning the effect 

x 

using precise techniques has on the reliability of observation statements 
one would cane to a different conclusion than following the principle con- 
cerning the effect of experience on reliability. But both principles must 
be taken into account. 
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.In this situation, as in any other situation in which the list of princi-^ 
pies will tye used, there is no way to give precise numerical weights to 
different principles Sound judgment based upon much experience using 
the prirtciples and familiarity with the type of situation must be used to 
determine the priority of competing principles. In the example unfler con* 
sideration I believe the instructor's statement is more reliable for the fol- 
lowing reaso ns,' T he instru ctor' s greater experi ence takes prec edence o^er 



the novice's using a more precise technique because of the vast difference 

t 

in experience, the small difference in p^cf^TorT, and the fact that experi- 
ence is, I believe, a more crucial requirement for making accurate measpre- 
ments. If the situation jw^s charv^ecj slightly so that the novice had sqme 
experience using the caliper and had become proficient in its use, then 
experience would probably be a less important factor than the difference in 
precision in making a reliability judgment. However, much would depend 
on how good the novice had become. / * 

Notice that in making. my judgment I h&d to rely on more than the 
principles themselves. Considering just the principles was. not sufficient 
for making a judgment. Other things, such as knowledge of the compara- 
tive importance of experience and the use of precise techniques, had to be 
considered. The lessen to be learned ffom this example is that the |4^in- 
ciples can be useful^ only when used with informed judgment based upon 
knowledge of the situation at hand and /experience in similar situations. 

In the section which follows I will attempt to clarify the meaning of 
each of the principles by showing how each rhay be used in particular 
cases. The section will also emphasize what was said in the last paragraph, 

be applied by using informed judgment. 

V 
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that is, that the principles must 
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EXPLANATION OK THE PRINCIPLES' . 

AND ILLUSTRATION OF THEIR APPLICATION 



Observation % an.d Inferences 

The first principle states that observation statements tend to be more 

reliable than inferences/ \jwsed upon them. The rfcason for saying this is 

-*«* 

tha,t inferences can go wrong in more places than the observations upon 
which they are based. Consider the following example, A person attends 



a display of archaeological findings from the ruins of Pompeii. One of the 
pbjects displayed is a glass 'bottle. The' bottle is quite symmetrical! has a 
very round opening at the top > and is coloured as evenly throughout as 
'bottles made today. Suppose based upon this final observation t hat person 
.infers that the* inhabitants of Pompeii could colour their glassworks as well 
as bottles are coloured today. This inference is less reliable than the 
observation statement that the particular bottle on display is coloured as v 
evenly as bottles made today. This is so because the inference depends 
upon many other statements being true in. addition to the observation 
statement. For example, it must- be true that the people of Pompeii were 
the ones who made the* bottle on display. This could be false someone 
visiting Pompeii from Greece many years ago may have brought the bottle 
to Pompeii. It must also be true/ that those who made the bottle were the 
ones who coloured it. This may be false. Maybe some chemicals,*' which 
were- in contact with the bottle during the centuries it was buried, coloured 

T ■ < 

it. This exampte shows that the inference xan' go wrong for all the reasons 
that the observation statement u^on which it is based can go wrong, but it 
can go wrong for other reasons >T&o. A He$ee, there is more of a chance 

* 4 

that the observation statement is correct. 
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This first principle is based upon the assumption that there is an im- 
portant distinction between the starting place and ending place in a line of f 
reasoning. There is,, I believe, a difference in the degree of immediacy of 
our knowledge between the statement that there is a green evenly-coloured 
bottle in front of us and the statement based upon this that the people of 
Pompeii were as skilled at colouring glassware as we are today. The 

distinction between observation and inference which I use in stating the 

.— : 

first principle is intended to capture this difference. The importance in 

capturing it is that the beginning points in our lines of reasoning teqd to # 
be more reliable than the points we reach through the reasoning and it is 
often helpful to know at which- places our lines of reasoning are most 
reliable. Recall, however,' .that the election ballot example of (he previous 
section illustrated a case in which the beginning points in a line of reason- 
irf^ are less reliable than the conclusion of this reasoning. 

Factors Affecting the Reliability of Observation Statements 
Consider the following case in which two opposing observation, state- 
ments are made. It is a. case which is not hard to imagine actually hap- 
pening. It is also a type of case for which the decision of which observa- 
tion statement to Accept could have important consequences for you. The 
problem is to decide wh>ich of the statements is more reliable. You read 
the following report in your morning newspaper. 

January 7, 1979 

Mr. Alan Wright of Stoneville reports having disc9vered a major 
defect in his new 1979 Venus. The Venus is a new model of car 
produced by Superior Motor Company for the first time this year. 
Mr. Wright says the incident happened while he was driving to work 
on the morning of January 5. On his way he must go dowrvover 
Murray's ttfcfl, \OTiich descends at a sharp incline for about two miles yjjp**'' 
before reaching the downtown area. About half way down the hill, 
Mr, Wright reports, the brakes of his car started to fade. * He says 
that he had to start pushing harder and harder on the brake pedal to 
get the same stopping effect. He said, "By the time I reached the 
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bottom of the hil 1 » pushing wi Hi all the force of my two^ foot barely 
brought the car to k atopT y Mr. Wright claims that in his thirty-five 
yea^s drivfng he has never experienced such an incident. He says 
he has reported the incident to the auto manufacturer and to the 
consumers 1 group in the town. 

We then interviewed a representative of Superior Motor Company who 
Wad the following to say. "Our quality control techniciarts tested the 
braking efficiency of twenty Venuses randomly selected from our 
December production. Each of the cars was brought to ten success- 
ive panic stops from sixty miles per hour. On the tenth stop none 
of the cars required more than fifty pounds of force on the pedal to 
stop the car at a rate of 0.9g . This is a very reasonable force to 

-expect -a-dr iver -to -ap pi y and--is-compara b le- to-t-he~force-r e qu ir ed-i n — 

the best cars on the market faday.' 1 

The observation statements I want to consider are the statements I 
have underlined. These statements are not in direct conflict with each 
other because both could be true. However, one provides evidence for 

. t 

- • 

and the other against a claim that the brakes on Venuses are safe. In 
thite* sense the statements do oppose each^other. You can also see that if 
yoif were considering buying a Venus, "believing one of the statements 
might lead you to make a different decision than believing the other. 

J will now demonstrate how the statements, could be evaluated accord- 
ing to the principles. 

« 

Area II. 1: Characteristics of the observer 
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The first set^of principles deal with the observer. Observers 1 char- * 

acteristics are ' extremely influential factors affecting the reliability of 
* 

observation statements. 

Emotionality . . The observer's degree of emotionality is a consideration 
because we know that many times our judgYnent is affected by our emo- 
tional state. For example, ah avid football fan may mistakenly claim that a 

foul was committed against the home team because of his or her emotional 

i' 

involvement in the game and his or her strong desire for the home team to 
win* 
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In the current example Mr. Wright was probably very optional. 

->,t " 

^lost people would become quite fearful in such a situation . We have been 
givtfn no evidence to the contrary so we can reaspnably m assume that he 
was emotional in this situation. This of course assumes that Mr, Wright at 
least believes he is telling the truth. It is possible that Mr. Wright's 
brakes did not fade at all even though he believed they did. In such a 
Qase he would probably experience the same emotions as he would if they 
really did fade. His observation statement- would be false ip this case ancf r 
the puzzle would be to discover what caused him to have the misleading 
perception. 

The fear emotion, if that irf what Wright experienced, would probably 

% 

be coupled after the incident with a feeling of anger while he was report- 
ing his observation. He might be extremely angry at the automobile com- 
pany for producing a car he considered unsafe/ Both of^these emotions 
could have influenced Wright's report. In his fear, the severity of the 
brake failure could have seemed much worse to Wright. In addition, his 
anger after the incident could have caused him tp exaggerate the severity 
of the fade. 

We have been given no evidence to believe either that the company's 
spokeswoman .was emotional when making her statement or that the techni- 
cians were emotional at the time they made the brake tests. The actual 

> 

tests were probably conducted before the cars were released to the public. 
So the technicians were probably not hampered emotionally due to pressure 
from Wright and the consumer group he contacted. The spokeswoman, 
however, was probably feeling some emotional presure when giving the 
report but likely not ad extreme as the emotions felt by Wright. Hence, 
the spokeswoman's statement was probably influenced less by emotional fac- 
tors than Wright's statement. 
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Alertness . From the iti formation wo are given we have no "reason to 
suspect that degree of alertness was a factor here!. We have no reason to 
beMcve that either Wright or the spokeswoman or the technicians were not 
paying attention to what they were doing . 

Conflict of interest . A person has a conflict of interest when it is to 
that person's vantage that others believe that those things he or she 
says are true. It could be to the person's advantage if he or she stands 
to profit from the statement made. The profit could be a monetary one or 
something like .the further advancement of a controversial point of view, I 
intend the hotton being to one's advantage to be taken quite broadly. 

JWe do not know whether Wright stands to profit from others 1 accept- 
ing his statement. We are not^given enough information. However, if we 
knew that^Vright was a member of the consumer organization with which he 
intended to register a complaint, this would be pertinent information in 
making our judgment. Such groups thrive on their ability to uncover 
safety-felated defects byproducts. However, in this situation we should . 
give Wright the benefit of the doubt and not assume that he is a member. 
Yet we should remain open to further evidence in this regard. Depending 
upon the importance of our making a correct judgment of the two state- 
ments, ? we might actively seek evidence about Wright's degree of conflict of 
interest, or we might deem that course of action too much trouble. 

The automobile company spokeswoman i s definitely in a position of 
conflicting interests. It is to the advantage of the auto company that 
Wright's statement be wrong and that the statement of the spokeswoman be 
right. Experience tells us that when the truth hurts there is a strong 
tendency to I|e 9 or to at least to distort the facts. We do not know 



whether the company spokeswoman has lied. All we know is that her 
statement is suspect. In such cases it is often wise to seek evidence on 
the statement from a source that does not have conflicting interests* 

Skill with thing observed . Wfc are not told whether Wright is skilled 
at observing the fading of brakes. However* we are told that he has been 
driving fot; thirty-five years. it is reasonable to assume that if a driver, 
with Wright's* experience says that his car behaved unusually, tfnert that 
car probably did behave unusually. This gives us roason to take Wright's^ 
word that he did have to exert an inordiante amount of force on the brake 
pedal to get his car to stop. ^ 

We are given no information about the Superior Motor Company's 

technicians 1 skill at observing the behaviour of auto brakes* It seems k 

reasonable, though, to assume that they had sufficient^ skill to make the 

observation reported by the spokesman.- The observations which were 

reported seem to be the type which automobile company technicians would 

make many times and the type that t£ey would be skilled at making. 

Theoretical understanding . The theoretical understanding people 

' V 

have of the field in which they are; making statements can affect the reu- 
s- 
ability jrf those statements. In the present case, whether the parties 

involved have a theoretical understanding of the way •automobile brakes 

operate could affect the reliability of their statements. The following 

discussion illustrates how Wright's theoretical understanding could affect . 

th^ reliability of his observation statements. ' . 

Wright reports in his observation statement that pushing with all the 

force of his two feet barely brought his car to a stop. What could have 

caused him to make this statement? One thing that could have caused him 

to make this statement is the event that the statement reports, if that 
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ovent reall y c,k! occur * H Plover , other thing* ..could have caused him to 
make^he statement. For example, if in fact the brakes did not fade* but 

« 

instead the power brake , system stopped functioning, then the car would 
not have behaved as Wright had reported. He would not have had to push 
as hard as he was able in order to barely bring the car to a stop. How- 
ever, if Wright had no theoretical understanding of the way brakes oper- 
ate, he probably would not^ have been able to distinguish the brakes 



fading from their losing their power assist. His lack of knowledge could 

then have caused him to interpret the change in the feel of the brakes as 

> 

being a serious problem, such as the brakes' fading, when it really was v 
not.. thinking something ' serious had 6ccurrcd he probably would become 
very anxious. This anxiety could then adversely affect his judgment of 
the amount of force needed to stop the car and of the quickness with" 
which the <rar came to a 'stop. If his judgment was adversely affected, his 
observation statement was probably alsdtad vers el "y affected. 

Your decision about ' the reliability of Wright's statement should, then, r 
be affected by what you know of his theroretical understanding of tl\e 
matter. If you know that Wright knew Tittle about automobile brakes, then 
this would reduce the reliability of what he said. To a persort who did 
not know what was happening, a failed power boost system could be easily 
exaggerated to almost a complete brake failure. If you do not know any- 
thing about the degree of his understanding, then whether you should try 
to find out. about it depends upon how important it is that you make a 
correct decision on the reliability of Wright's statement." However, without 
any more information about Wright, you? should probably suspect that he 
has practically no understanding of the functioning of brakes. This sus- 
picion might be based upon the fact that most people lack this understand- 
ing. 

v> A. 
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Regarding the company's spokeswoman different assumptions must be 
made. In the firsU place, the spokeswoman is reporting on what some 

y / 

other people have Observed. The theoretical understanding of the techni- 
cians who made the tests on the brakes is \vhi\t should be considered in 
this case. Unless you have reason to" think otherwise, it is safe to assume 
that these technicians have a deeper understanding than Wright of the 
brakes on a car. Such understanding could affect the reliability of their 
observation reports in many sways. Consider the following situation. A 
test is performed on the brakes of a car and it is found that they perform 
poorly. There is a great deal of fade. However, theory would lead one 
knowledgeable in the field to suspect thnat the brakes should operate well 
because of the following considerations: the material used fo^r the friction 
surface has theoretical properties which would lead such a person to think 
(that it was highly resistent to fade; the brakes were specially designed to 
dissipate large amounts of heat, and keeping brakes cool is a known way 
of reducing fade; and the brakes should havf been adequate for a car 
twice as heavy as the one on which they were tested. These things might 
lead trained technicians to suspect the measurements they have made, that 
is, their observations. Suppose, on the basis of such a suspicion, they 
check the instruments t and discover that the instrument for measuring the 
pedal force was defective. In such a case, their theoretical understanding 
of the situation would have prevented them from making an observation 
statement that was incorrect. If you. assume, then, that the technicians 
have a high degree of theoretical understanding of the phenomenon they 
are examining , you should rate theifr* statement more reliable because of 

to 

this. X 
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NormaJ senses. For Wright to nave made a reliable observation it was 



necessary that his senate of touch was operating correctly. We are given 
no reason to believe, otherwise* In addition, the sense of touch does not 
seem as susceptible to malfunction as gome of the other senses. Eyesight 
and hearing seem to ca\ase problems in larger proportion pf'the popula- 
tion. It, would probably be safe to assume that Wright's sensory equipment 
was^in good working order. 



The observation reported by the auto spokeswoman required the tech- 
nicians to use sensing apparatus in addition to their own senses. Such 
apparatus as therrpometers, acceleration meters, and pressure gauges were' 
probably needed. 'The various instruments for measuring dec eleration 
rate, applied pedal pressure, and temperature of the brakes can all be 
considered part of the sensory apparatus used to make the observation. In 
addition, more than one technician was involved and it was necessary for 
the condition of each of these person's senses to be operating correctly. 
The pQint is that there were more places for unreliability due to Sensory 
equipment failure, b^th human senses and sensing machines , to invade the 
autb manufacturer's test. However, this source of unreliability was coun- 
tered by the possibility of seeking coherence from the varied sources of' 
data. A piece of malfunctioning sensory equipment cobld have been identi- 
fied if the data it provided did not fit in with that provided by other, 
sources* For example, a large malfunction in the apparatus for. sensing 
the degree of deceleration could be detected by the technician driving the 
car because the technician probably had a "feel" for whether the instru- 
ments were working correctly,. Of course small errors would not be no- 
tlced in this- way . 
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Unless some specific piece of information was known which cast doubt 
on the reliability of some piece of sensory equipment, then the principle 
being considered would not help you, in this case, to judge the, more reli- 
, able statement! 

Reputation for veracity . When a person or group of persons has 
been known not to tell the Jtruth in certain situations, then we are justi- 
iled in suspect i n g furth er state ments m ad e_ by that perso n or group of 
persons. A reputation for not telling the truth should not be identified 
with a reputation for lying, although lying is one of the things that 
affects a person's reputation for veracity. 

Often, we can point to th<£ cause of a person's continually not telling 
the truth in certain matters. For example, we might attribute the falsity 
of the person's statements to that person's lack of knowledge in the field 
about which the statments are made. If that person makes another state- 
ment in that field and we have no reason to think that he or she has 
increased his or her knowledge'of it , then we assume, justifiably that the 
same lack of knowledge might cause the person to make another" false 
statement. 

We learn nothing from the newspaper report s/bout Mr. Wright's repu- 
tation for telling th« truth. I believe our course of action in this matter 
should be to give Wright , the benefit of the doubt, unless it is extremely 
important for us to know whether or not he was speaking the truth. If it 
is important, it would be reasonable to explore Wright's reputation. Other- 
s-wise, we should assume that Wright is speaking ithe truth because it is, I 
believe, the overwhelming tendency for most human beings -to speak the 
truth in most situations. 
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The spokeswoman's statement ought to be viewed differently in this 
regard. Automobile manufacturers have a poor reputation for speaking the 
truth with regard to the qujGlty of their cars, One of\t^e major factors 
causing this is, their concern with selling as man y cars as possible ♦ Thi s 
is reUted to the conflict of interest problem discussed previously. Since 
we have no reason to believe that this auto manufacturer's reputation for 
veracity is better than that of any otjier manufacturer, then it is'reason- 
able to suspect the reliabilty of the spokeswoman's statement*. 

The reputation of automobile manufacturers for telling the truth about 
their products is so poor that one may wish to make a judgment at this 
point. One may wish to say immediately/that Wright's statement is more 
reliable. There is a> practical reason for doing this. The auto spokes- 
woman has received negative scores on both conflict of interest and repu - 
tation for veracity . These are serious charges. They may be so serious 
that it is difficult to imagine any combination of positive factors overriding 
these two -negative factors. I believe this is so' in the present situation. 

At this point, then, I would take Wright's statement to be more reli- 
able and would base my actions upon this position. If I had intended to 
buy* a new Venus, I would, on the basis of Wright's report, not buy one 
at the present time. I would wait for the Venus brakes to be tested by 
some reputable and independent group and make my final decision based 
upon that group's report and reports from other owners of Venuses. The 
practical advantage of making my decision at this point in the evaluation of 
the statements is that I save time by not going through all the criteria. 
If my concern for saving time causes me to make an incorrect judgment I 
would not have put myself in -danger since I chose not to .buy a Venus. 
Hence, saving time may be to my advantage. In other situations,' it might 
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not be reasonable to make a judgment until many more criteria have been 
examined. 

The discussion so far does not present the only way in which deci- 
sions regarding the reliability of observation statement are made* Often, 

♦ * -« 

the person making a decision will not j^tin through the list of principles 
one at a time* as I did .in the auto-brakes example. Rather, the person 
will notice that one or two criteria ar£ particularly relevant to the case 



being examined. For example, ir^the auto-brakes case a person might 
immediately see the relevance of the conflict-of-interest principle and the 
reputation-for-veracity principle in judging^Hiie reliability of statements in 
this situation. The person wlN then rtiake the judgment, seemingly based 
on consideration of only these M^jvo principles that Wright's statement *s 
more reliable. I used, "seemingly based 1 ' in the last sentence for a special 
reason. The reason is this : When basing a judgment upon only those 
principles for which the relevance is immediately seen, a person skilled in 
the use of the principles is assuming that if the relevance of a principle is 
npt immediately seen, then it is probably not relevant. In fact, then, all 
of the principles are taken into account'. Some are taken into account 
explicity; those usegl to make the judgment. Some are taken into account 
implicity; those which are assumed to have no bearing. This procedure, 
when used by skilled people is justified because it usually leads to correct 
decisions. Whether or not you should use this technique rather than a 
more systematic 1 appraisal o£ each principle's relevance depends upon "your 
6 kill in applying the principles, upon your familiarity .with the topic being 
evaluated, and upon the importance that you rtiake a correct decision. The 
less skilled and the less familiar you are, and the more important the 
issue, then the more reason there is for you to use the systematic 
approach. 



So f^r in this section I have demonstrated how some of the, principles 
dealing with characteristics of the observer can be applied to a particular 
situation by using them to make a (decision about the comparative reliability 
of two observation statements. I will now discuss each of the remaining 
principles by explaining their meaning and by showing how they might 
apply in particular situations'. I will begin by discussing those principles 
which were not discussed in the auto-brakes example concerning the rela- 



tion of a statement's reliability to characteristics of the observer. 

Precise technique , I intend the phrase "using precise techniques 1 ! to 
be taken broaHly. Often I will use the phrase to help characterize a 
person's using ,some sort of instrument to help make some observations-. A 
person using a v thermometer to tell the temperature o( some water is using 
a more precise technique than a person merely using his elbow. At other 
times I will use the phrase to characterize the c£re and attention to dis- 
turbing factors which a person exercises in making an observation. A 
person who reads the scale on a thermometer by looking straight at the 
thermometer is using a more precise technique than a person who reads 
the thermometer by looking at it obliquely. ^ 
In stating the principles concerning the use of precise techniques I 
use the wording "as precise a technique as is appropriate . jf 1: use "as is 
appropriate" for the following reason. In some situations using a tech- 
nique which would be more precise does not add to the reliability of the 
statement based upon *the observation. This is so when the technique is 
more precise than is needed for the statement that is to be made. In the 
example of testing the temperature of the water , suppose the statement to • 
be made was one of the following: f The water is too hot for bathing 1 or 
'The water is not too hot for bathing.' In most situations in which water 



ERJC 



• 33 



37 

is tested* for the purpose of Bathing I do not believe that using a ther- 
mometer instead of one's elbow adds to the reliability of .the statement 
about the w> 8uitability of the water's temperature. In fact in many situa- 

i ^ 

tions it would decrease the reliability if, for instance, it was not known at 
which temperature-in-degrees water is suitable for bathing. 

Skill in technique . Being skilled in the observation technique being 
used is different from being skilled in observing the sort of thing ' 
observed. This latter skill has been discussed already. A person who is 
not skilled in a technique does not know t he sources of u n reliability i n 
using the technique. Consider the technique involved in using a ruler to 
meatsure the length of something. A person not skilled in measuring "this 
way will not know that unreliability of measurement can arise^K the rule is 
distorted near its ends or if the scale does not touch the thing being 
measured. 

Preconceived notions . Under some conditions having preconceived 
notions of the way observations will turn out tends to decrease the reli- 
ability of observation statements based upon those observations. This is 
so because under some conditions people see what they expect to' see even 
though things are not really the way they are expected. I say !l under 
some conditions" because in situations of which I can think, the mere fact 
that a person has a preconceived notion does not reduce, the reliability of 
that person's observation statements. It is that person's having the 
preconceived notion in combination with certain other facts about the 
person which makes his or her statement Jess reliable. For example, I 
would not want to say that usually the reliability of scientists' observation 
statements which report observations that they had previously predicted is 
reduced because they had preconceived notions of the way the observa- 



tions would turn yut. However, if certain other things were true of the 
scientists, such as their getting additional funding depended upon the 
observations predicted being made or their lack of experience caused them 
not to take proper safegixtrds against making incorrect observations, then 
their having preconceived notions of the way the«obj?ervations would turn 
out would teijd to reduce the reliability of their qjoservation statements. 
In these situations the scientists' conflict of interest or their lack of 



experience alone would tend to reduce the reliability of their observation 

statements. The advJed factor of tl\eir having preconceived notions^ tends 

to make ^hem make a particular unreliable statement , that is, it tends to 

make them even less open to alternative observations than they would be' 

without the preconceived notions, , -) 

It is also worth noting that persons 1 having preconceived notions of 

the ways in which their observations will turn out can lead to their making 

correct observation , statements that otherwise they would* not make. A 

preconceived notion can suggest to a person things for which to lQok and 

ways and places in which to qbserve. As long as ty(ai person keeps irf 

mind that he or she must not allow his or her preconception to distort his 

or her observation, then having the preconception can be - beneficial • 
v • 

In summary, the- prinicipie covering the effect of preconceived notions 

on the reliability of observation statements must be applied with extreme 
caution and informed judgment. 

• * 
Area II. 2: Characteristics of the observation conditions ' 

The two principles contained in this subsection seem almost too obvi- 
ous to need stating. However, I include them in the list to serve as 
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reminders of thing* that need to bti checked when assessing the reliability 
of observation statements. 

The first principle states that the reliability of observation statements 

depends upon the medium of observation. To make reliable statements the 

I** 

conditions of the environment .must not impede the sensing process! Foggy 
or smoky conditions interfere with the sense of seeing; magnets interfere 
with compasses; background noises interfere with our hearing particular 
things; the atnrfbsphere interfer^ with the use of telescopes. To overcome 
this last source of unreliability of observation statements space scientists 
plan to mount telescopes on rockets orbiting the earth. In this way they 
will eliminate the interference from the earth's atmosphere, and thus have 
a more satisfactory medium for making their observations. 

The other principle states that the reliability of observation state- 
ments depends upon whether the observer has good access to the phenome- 
non he or she is observing. So, for example, the claim that a particular 

painting was done using a certain kind of brush stroke is more reliable if 

... ^ ■ 

■ \ 

made by a person who can touch and view the painting a4 close range than 

» 

a claim made by this person if the painting could be viewed only from a 
distance. 

There are exceptions tfibugh. Suppose a person looks at the moon 
with the naked eye and declares that the moon is in its first quarter. 
Suppose, instead, that the same person had looked at the moon through a 
telescope and made the same statement. Although he or she would have 

• L 

had better access to the moon through this instrument, I clfc not believe 

t 

this statement tends to be more reliable thlfc the first statement because of 
this- fact. For the claim that was made, looking through a telescope offers- 
no advantage over using th* naked eye. However, if th^e claim was differ- 
ent, about craters oh the moon, say, then the f observation made using the 
telescope might tend to be more reliable. 
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Instruments, such as telescopes, are used to gain access or to gain 

" " ~ . " » ~ "" . « — - ... _ . .... 

better access to phenomena that would without the instruments be inac- 

cessable to observation or only poorly accessible . Because instruments 
are used to increase the accessability of phenomena to observation , ; P^" 
ciples governing, the reliability of statements based upon their use are 
included under the more general principle about the accessability of phe- 
nomena. A discussion follows of the reliability of observation statements 



made using instruments* 

$ I will use 'instrument 1 to refer to a wide variety of devices which are 

f 

used either to increase the accuracy of an observation or to make an ob- 
servation possible. Such things as rulers, thermometers* bathroom scales, 
speedometers, achievement tests, ammeters, clocks, electron microscopes, 
and smoke detectors arejjfcstruments in the sense I am using the term. 

In order to disc usaff?some principles which are helpful in judging the ' 
reliability of observation statements made with the help of instruments 
imagine the following situation. You plan to buy a piece Of plate glass to 
protect the surface of an antique wooden table you just purchased. The 
table is constructed to hold such a piece of glass. On each side of the 
table there is a moulding which extends about one-quarter inch above the 
surface of thte table. The piece of glass is supposed to fit snugly in the 
frame thus made. You begin to make the measurements before placing 
your order. 

Suitably precise instrument . When I say that an instrument is more 

precise than another I shall mean that the more precise instrument is con- 

t 

structed so that the measurer can confidently make a finer discrimination 
'between valufes than can confidently be made using the les$ precise in- 
strument. # For example, an IQ test which can dependably detect 



differences in IQ as small as 5 points is more precise than an IQ test 

V 

which can dependably detect differences in IQ only if those differences are 

-« ' i 

greater th*n 10 points. 

If the isame observation statement is made using two instruments, one 

more precise than the< other, then following this principle a person would 

judge the statement more reliable when made using the more precise instru- 

ment. This is so because the closer an instrument is pusheyd to the limit 



~of~itS "capabilityT ~the~Iess dependable measurements are. If u s eel to" rcia Re" 
the same statement, the" less precise instrument is pushed closer to the 
limit of its capability than the more precise instrument. 

Not all observation statements bas4*d u|x>n more precise instruments 




are more reliable than those- based upon less precise instruments. A 
temperature reading of 36.45° based upon an instrument designed to mea- 
stfr* to two decimal places might be just as reliable as a temperature 
reading of 36.452° based upon an instrument designed to measure to three 
decimal places. If the instruments are of equal quality and used by equally 
skilled measurers, then the reliability of the statements is likely to be 
equal. This is so because although the statement based upon the more 
precise instrument gives a more accurate measurement and thus tends to 
be more reliable, it also makes a stronger claim about what the measurer 
knows and is thus harder to defend, tending to- make it less reliable. 
Having no way to judge the relative size of these counteracting factors it 
lis best to assume their combined effect is zero. 

Suppose in your case you do not want the glass for your antique 

N 

table to be more than one-sixteenth indh shorter or narrower than the 
frarhe. Therefore, you need a measuring instrument that will allow you to 
distinguish measurements as small as on^e-sixteenth inch. If you choose 
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•uch an instrument your measurement will be more reliable than if yoXi had 

- • - ■ - - ■' ■ v ' " 

chosen an instrument of lesser precision, given that the measurement you 

make is expressed in dimensions of one-sixteenth inch. 

Range of application . An instrument is used beyond its range of 
application if it is used to make an observation for which it is not suit- 
able. For example, second hands on wrist watches are not suitable for 

r 

making observations of time differences of less than a second or so. 
Observation statements of time differences of the„ order of one-half second 
made using a wrist watch tend to be unreliable. Measuring sticks and 
tapes used to measure length tend to give more reliable measurements when, 
the thing being measured is shorter than the stick or tape than when the 
thing is longer. If you used a one foot ruler to measure your antique 
table and that table was three feet long, unreliability would enter your 
measurement each time you had to mark the position of the end of the 
ruler and move the beginning of 'the ruler to that [x>sition. You could 
avoid this source of unreliability by using an instrument whose range of 
application is more suitable to your task, A ten foot steel tape, say, 
would be more suitable. 

Good quality instrument . Instruments come in various qualities , The 
quality of ^instruments affects the accuracy and hence the reliability of 
statements based upon their use. Thermometers, in which the tube carry- 
ing the liquid varies in diameter tencl to be less accurate, than thermom- 
eters in which the diameter varies by smaller . amounts. Compasses in 
which the needles sometimes stick on ttie glass tend to be less reliable 
indicators of direction tfian compasses in which this does not happen. 

The quality of the * a P^ measure you use in measuring your antique 
table affects the reliability of the measurements you give. If the markings 



on that tape are not evenly spaced , your measurement will tend to be less 



reliable than if you had used a tape on which the lines were evenly spaced. 
If the tape you use is not straight, your measurements. wi|[ tend to be less 
^reliable than if you had used a straight tape. 

Instrument's workings gre understood . If no one- can give good 
reason for saying that an instrument measures a particular thing, then 
that instrument tends be a rn^re undependable measure of that thing 




than an instrument tfia^ts well understood. The explanations of why 
instruments work vary in kind and in quality. Generally speaking, more 
complicated instruments require more elaborate explanations of their work- 
ings than is required by less complicated ones, if the instruments are to 
yiel^ equally reliable measurements. 

The body of knowledge explaining how rfn instrument) works is often 

r 

the bgdy- v of knowledge that was used to design the instrument in the first 
place. This is not always the case. The first telescope was constructed 
before anyone knew how telescopes worked. When *\n instrument is de- 
signed according to a more corroborated body of knowledge than another 
instrument, we can depend upon that first, instrument more than the other 
to ip^asure what it is claimed to measure. The instrument that is based 
upon the more corroborated body of knowledge is more likely to be doing 
what it is claimed to do. This is so because the more corroborated Body 
of knowledge has bqen subjected to more tests and has passed more tests 
than the less corroborated one. Loosely, thia means that more ways in 
which the body of knowledge could have gone wrong have been eliminated, 
and more ways in which the instrument might have been constructed incor- 
rectly are eliminated. % 



In your caseyof measuring the dimensions of a table, the workings of 
the initrumefTtyou will use are well understood. 

Good working condition . That instruments need to be in gj^od workl* 
ing condition in order to give reliable results is t 1 Relieve, unlikely to be 
disputed. Stating the principle is, however, worthwhile. It is a reminder 
of a factor which might adversely affect the reliability of observation 
statements and thus of a caution to keep in mind when trying to make 



observations. The working condition of an instrument can be affected by 
many things. For example, the working condition of the ruler you might 
use to measure your table could be affected by its de^i^e^of straightness, 
\ the clarity of its scale, and the amount of wear near its end. 



Area 1^3: Characteristics of tht? observation statement 

The reliability of observation statements varies with certain character- 
ist ics of the statements themselves. Some of the principles in this section' 
are not as apparently true as those in the last section; I will thus devot^ 
more time in this section than in the last to explaining and defending each 
principle. 

Committment of speaker . This principle states that an observation 
statement tends to be more reliable than another when it commits the 
Speaker to holding fewer things true than that other statement. The prin- 

% m 
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siple is intended for use in cases like the following one. This is a case 
that has been discussed previously. Consider a speaker making one or 
the other of the following two statements having observed the reading on 
the thermometer: "The temperature in the room is 70 o,! ; !, The top of the 
lifttfid in the thermometer is at the number 70." In the context I am 
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Imagining the speaker is committed to holding more things true when 
Mterting the' first statement than when asserting the second. The first 
statement commits the speaker to holding true all that the second statement 
commits him or her to holding and in addition commits the speaker to 
holding other things true. The first statement commits the speaker to 
ffdding that the room has a particular temperature, The second statement 
does not commit 1 the speaker to this. 



Corroborated . When statements become more corroborated they also 
become more reliable.' To become more corroborated they have to with- 
stand more situations in which their truth is put to the test. A principle 
of diminishing returns applies here though. The more a statement is put 
to the test, the less its reliability increases with the passing of each test. 
For example, the amount by which the reliability of the. statement "There 
^ was a loud boom in our city last night" increases is less when the one 
hundredth person claims to have heard if than when the tenth person 
claimed to have heard it. Howe ver, the discovery of a ne\yjjp^pe of evi- 
dence would increase the reliability by a larger increment than the addition 
.of more evidence of the same type. If it was discovered after the one 
hundredth person had confirmed hearing the loud boom, that, unknown to 
anyone, a rtfllick carrying explosives had exploded just outside town, this 
discovery would confer a larger amount of reliability on the statement that 
there was a loud boom "than another person's, claim to have heard the 

noife. 

w 

Observation statements can become more corroborated irii other ways 
than being put directly to the test. Consider the statement that the . 
Atlantic Ocean is gradually becoming wider. This statement reports an 

. . / 
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observation mad© using very sensitive instruments. It forms part of \he 
evidence for the' theory that the continents were once joined together but 
are slowly drifting apart. Suppose the theory received independent sup- 
port from another source. Suppose, for instance, that a type of rock 
formation is discovered on the east coast of South America and on the west 
coaat of Africa. The formation is unknown in other parts of the world. 
The new discovery lerlds additional support to the theory that these two 
continents were once joined together and have since drifted apart. How- 
^ ever, since the theory of the drifting continents is now more corroborated, 
the observation statement that the Atlantic is widening is also more cor- 
roborated and thus more reliable because we have an additional reason for 
believing the statement. The reason is that the statement fells what on| 
would expect to find given the theory is true and there is now more 
reason to believe the theory is true. 

Justified precision . The precision that can be justified in aVobser- 

vation statement is dependent partly upon the 'technique used. UjsiAg a 
• v J - 

good quality, wooden meter stick a trained scientist would be justified in 

giving lengths to two decimal places. Using a vernier caliper he might be 
able to give readings to three places, depending upon the quality of the 
particular instrument being used. A pilot flying over the site of a county 
fair would probably be justified, depending upon his experience in such 
matters, in saying that there were between two thousand and three thou- 
sand people at the fair. However, a pilot would be unjustified, in most 
situations I can imagine, in saying that there were two thousand three 
hundred fifty-one people. The technique of observing crowds of people 
from the air just does not allow one to be that precis^. When the pre- 
cision claimed in the observation statement is greater than that which could 
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be reasonably expected from the technique being used, the reliability of 
the statement it reduced. 

Close to time of observation > Many things can happen to interfere 
with the accuracy of Jpi observation statement between the time an obser- 
vation is made and the time the statement is given. Some interferences 
arise because many people have bad memories and because often people 
confuse things with other things they have observed. One way" to help 



minimis* the errors which occur from these sources is to make the obser- 
vation statement as soon as possible a^pr the observation is made. The 
purpose of this principle is to urge that statements which have been made 
with this precaution tend to be more reliable than those which hay,e not 
been so made. ^ — \— 

Person who made the observation . This principle states that an ob- 
servation statement tends to be more reliable when it is made by the 
person who made the observation. The principle is based or%he following 
widely accepted statements. When information is passed from one person 
to another there is a chance that something will hinder the second person 
giving an accurate report of what the first person said. Accuracy of the 
second person's report would be hindered if that person places an inter- 
pretation on what was said that is different from the one the first person 
intended. The second person's memory is also a source of hindrance to 
his or her statement's accuracy. As the chain of people grows, the 
number of sources of error increases. Hence, the statements given by 
people removed from the original observations tend to be less reliable than 
the statement made by the* person making the observation. 

These last two principles do not rule, out the possibility of making 
reliable observation statements using informaton from other people . or 

4 Q 
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making reliable observation statements a long time after observations have 
occurred. ' In many situations people do things to counteract the unreli- 
ability introduced by such factors. One way to do this is to make a 
record of the observation at the time the observation is made. Using such 
a record I can thus make a reliable observation statement stating that the 
'• maximum temperature on November 8, 1978 was 8°C in Toronto, Canada. 

However, if we use records we need principles to judge the reliability of • 
"statements made "using them. The~discu7sion of such"p7in~d^les will be~the~ 
focus of a subsequent section. . 

Belief the statement is cor roboratable . This principLe states that if 
an observer believes his or her observation statement can be checked by 
other people, then it tends to be more reliable than if the observer did , 
not believe this or if he or ^he believed the statement could not " be 
checked. The following example illustrates the principle. Suppose you 
bring your watch to a repair shop and complain that you have seen the 
date indicator skip- a day on several occasions. The jeweler examines your 
watch and finds nothing wrong'. Despite this the jeweler might judge your 
complaint as reliable. You were willing to submit your statement for 
independent corroboration. If you did not believe that your statement was 
correct you would not likely have gone, to the repair shop. It is embar- 
rassing to be shown wrong by other people and we try to avoid placing 
ourselves in embarrassing situations." This tendency to try to avoid being 
shown wrong tends to make your statement to the jeweler more reliable. ' 

As with the other principles, in some cases the final decision on the 
reliability of a statement will be in the direction urged by this principle. 
In other situations the direction of the final decision will be opposite to 
that urged by the principle. Suppose a school-aged child announces to 
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hi. parent, on the morning that his class is to have a mathematics qui* 
th.t h* ha. * bad stomach ache. Suppose, in addition that the parent, 
knew that their child had not studied for .the test as much as he should 
have. It is reasonable to assume the child believes that his observation 
statement reporting his stomach ache is not easily checkable by other 
people. This tends to make the child's statement unreliable. In addition, 
it would be advantageous to the child if his parents accepted his statement 
--(-they-wouJd-^ 

would probably judge his statement unreliable. In this situation the prin- 
ciple concerning independent checkability points one in the same direction 
t towards unreliability, as the direction of. the finaf decision. 

Suppose, however, that another child claimed to have a stomach ache 
on a day she was to go camping. Suppose she was looking forward to this 
camping trip very much. As in the' previous case the fact that h*r-state- 
ment is not checkable by other people tends to make it less reliable than a 
statement that is so checkable. However, since it would be . to hex dis- ■ 
advantage for her parents to act upon her statement, the child's statement 
should probably be judged reliable. In this situation the principle concern- 
ing independent checkability points one in a direction opposite to that of 
the final conclusion. 

Fits into a body of knowledge. The reliability of an observation 
statement is enhanced when it describes something expected in the light of 
a larger body of knowledge, and diminished when it describes something 
not expected in light of a body of knowledge. Here is an example. An 
abnormally high air pressure reading in the tires of your car is reliable if 
the tires were set to the normal pressure when the temperature was much 
colder and if the sun has been shining on the tires for several hours. 
The body of knowledge conferring this reliability includes our 
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experiences showing that pressure increases with temperature a^d the 
theoretical explanation in physics explaining why pressure increases with 
temperature. Reliability is conferred to the obervatkyf of the abnormally 
high pressure by the larger body of knowledge because the body of know- 
ledge is itself reliable, and because onS Would expect an abnormally hijgh 
pressure in light "of this body of knowledge. An observation of a normal 
air pressure in the Situation described would-be unreliable because it 



wQuld conflict with ^something in which we have very good reasons to 
believe. 

Here is ariother example illustrating this principle. When driving on 
the highway on a sunny day an observation that there is water on the 
road ahead is made unreliable by the wealth of experience indicating that 
many such observations in simitar situations have proven to be wrong. It 
is also made unreliable by the fact that science can explain why the road - 
appears wet under these conditions when, in fact, it is not wet. 

As with all the principles, cauMon must be exercised when applying 
this principle. There are cases in which observation statements can be 
instrumental in the overthrow of bodies of knowledge, even though follow- 
ing this principle would lead one to judge the statements unreliable in ligh t 
of those bodies of knowledge. For example, it was once believed that 
bodies while burning give off a substance called "phlogiston " . Also , it 
was observed at that time that some substances increase their weight wh^n 
burned. Accepting the belief in phlogiston, observations of materials 
increasing their weight when burned were justifiably judged unreliable. 

However, accepting other bodies of knowledge concerning the weighing of 

» 

materials which existed at the same Ame the phlogiston theory was held,/ 
the observations of increased weight were justifiably judgjed reliable. The 



•trong belief by some /icientists of the phlogiston era that the observations 
of increased ""WfcjfhT* were reliable ledf them to the development of another 
theory of combustion. This new theory, which did not postulate the 
existence of the substance phlogiston, predicted an increase in weight of 
•ome burned objects. It is essentially the theory we hold true today. 
Hence, an observation statement like "This material's weight increased 
when it was burned", which is justifiably judged unreliable in light of the 
phlogiston theory, was instrumental in the overthrow of that theory. 

Based upon a> record . There are occasions when people want to make 
reports of observations that were made, sometime in the distant past 1 . On 
such occasions people often appeal to their memories to recall what hap- 

% 

t 

pened. However, experience has shown that memory is very unreliable. 
To help alleviate this unreliability in reporting on past . observations, 
records of observations are pften made. When a person uses a record to 
report an observation, .1 will say that person's report is" an observation 
statement. For example, if a person using information gathered in a news- 
paper reports that the sun rose at 6T03 a.m., I will call this report*an 
observation statement. I will consider the fact that the person making the 
statement is not the one who made the observation unimportant in identify- 
ing the statement as an, observation statement. What I will consider impor- • 
tant is the- fact that the statement does report what someone observed. 

Observation statements based on records in this manner can have 
various degrees of reliability. The degree of reliability such observation 
statements have is' partly dependent upon the quality of the records. I 
will Illustrate with an -example some principles for judging the reliability of 
observation statements taken from records. 
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Suppose you are a patient In a Jiospital Your doctor visits you, 

' " - " s 

reacis your medical chart and reports to you that your blood pressur^ 



1 the doctor^ 
recorded by 



reading is 120/80. The blood pressure redding upon whic 
bases this claim was made by a nurse a while ago and was 
that nurse on your chart.* The doctor judges the observatibn statement 
she made reliable. At least you assume this from the confident manner in 
which she stated it arid from, the fact that she bases caption upon the stater 



ment (she reduces '^your medication) . On what grounds might you judg^ 
whether her statement ^^ceiiable? > 

Records of observations tend to ; be mord reliable when they a re. made 



at the tifne Qf the Observations. Nurses are trained to ' record their obser- 

4 

vations as soon as possible after they are made, This practice reduce? 

the chance that what is recorded will be distorted by things such as poor 
v memory or the confusion ot one patient's statistics with those of ariother 

patient. Most nurse-s do as they are trained.. Because nurses usually 
• make their records at the time of their observations, the record of your 

blood pressure tends to be a more reliable indication of the pressure your 

nurse observed than if, say, nurses usually made all their records at the 

end of their Workday. 

t " 

The reliability of records of observations tendtf^to be decreased if 

they are made by persons different from those who made the observations. 

This is so because the transmission of the information from the observer to 

the recorder adds another source oi error that is not present when the 

observer makes the record. You probably know whethefr 1 tjie nurse whr' 

observed youi blood pressure also recorded the pressure reading on your 

chart* If the obsir^er and, recorder were the same person, the record ^ 

* » 

*— » * 

tends to be more, reliable than ii thaty were different people. 
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If the person or group making a* record has a reputati9n for making 
correct records, then this fact enhances the reliability of observation 
statements based upon that record . This is so ^because the making of 
correct records on a number of occasions is evidence that the gro\jp will* 
make correct records on other occasions. Nurses, in general, have a 
reputation for making correct records in situations where A their job re- 
quires them to make records. Your doctor will probably have information 

~ 7* ~~ ' * """" ■ " 

on the reputation of the particular nursa who made records of your medical 

i ' 

statistics. If that nurse has a reputation for making correct records, this 

informatiort would tend to increase the reliability of the. doctor's statement. 
If thie particular nurse has a reputation for making incm*rect records, 
then the records are npt dependable sources upon which to base observa- 
tion statements. 

If the person making an observation statement from a record believes 
that the? record is correct, then under some conditions that person 1 ^ belief 
tends to make the statement more reliable. This principle is difficult to 
grasp, and may be difficult to accept as I have just stated it. I will 
a.ttempt to justify the principle. 

When people- claim to believe the records upon which they base their 
statements, then they often have some reason to support their beliefs. 
For example, your nurse might now believe that the records your doctor is 
using are correct because he remembers believing that they 'were correct 
at the tinrtrtfchey were made. If your nurse usually bases his belief upon 
sound reasons, then he can assume that ; at the time the records were made 
he based his belief in their correctness upon soynd reasons. This justi- 
fies his believing the records at this time even though he may not remem- 
ber his initial reasons for believing the records. Thi's in turn gives us a 
reason to believe the' records. 



In another situation a person may believe,, that a record is correct 
beqause he or she believes that the person who ma|e the record usually 
makes correct records. Such a belief^ for most people, would be based 
t*pon ^some experience ^ith the reco^d-maker^s ability to make records, 

A main point of the two cases I just described is to point out that, in 
discussing this principle, when I say "belieffk I mean justified belief not 
mere belief. 

— ; — — — ^ i_ _ _ 

If your doctor tries to assure you of the correctness of your records 

by saying that she believes the records are correct, you should place some 
confidence in this statement. You ought not, unless you have a special 
reason, take the doctor's statement as trivial, as a statement of mere 
belief. Rather, you should assume the doctor bases her belief upon some 
sound reasons, and that these reasons make a statement based upon the 
records more reliable than if , reasons could not be given. 

The final decision about the reliability of your doctor's statement 
needs to be based on principles other thafi those relating to records. The 
observer must be taken intp account, as well as the observation condi- 
tions, the nature of the statement made, and the instrument or instruments 

< 

used to help make the observation^ The medical profession has specified a 
manner for making and recording observations which enhances the reli- 
ability of observations of patients as much as is reasonable to expect. 
The observers are trained well, are usually alert, use precise techniques, 
etc . The conditions are also favourable for making reliable observations , 
Rooms are usually well lighted, there is usually a minimal amount of dis- 
turbancj*, etc* Instruments are usually of high quality, have been exten- 
sively tested, are used by people skilled in their use, etc. Upon these 

■ \ 

facts, as well as upon the considerations offered in judging records, you 



ought to judge that the doctor's statement of your blood pressure is reli- 
able. * > 

I am' not suggesting that you ought to go through such thought P r ^~J 
c ? Me &jiijP J^ge ^e observation statements doctors make in their work. In 
fact-i^he usual practice is to assume their statements are reliable unless 
something is noticed which appears to cast doubt upon their reliability. Iri 
many situations it would be innappropriate to^>attempt methodically to 
apply, one by one the principles offered here to judge the r^liability^of a 
statement • A more reasonable approach in the blood pressu re example 
would be to take the statement as reliable unless something stood out 
which indicated that the reliability was in doubt. One value of the prin- 
ciples is that for people versed in them reliability-reducing factors "stand 
out" more quickly and more obviously, t han for those not. versed in them. - 
Thus a person knowledgeable of the principles is likely to identify an 
unreliable statement before a person* who is not familiar wi'th them. 
Another value of the principles is that they can serve as guides for mak- 
ing judgments of reliability in difficult or unfamiliar situations wH<lre the 
judgment which should be made is not obvious. Still another value is that 



they can serve as guides to practice in formulating procedures to enhance 
reliability in situations where many reliable observation statements must be 
made. A final value is that the principles can serve as a pedagogic device 
to introduce students in a systematic manner to a compUx set of .problems 
and procedures for dealing with these problems. 

* SUMMARY 
In this paper I have offered a conception of observation statements 
which distinguishes those statements as those which tend to be the most 
reliable statements of our knowledge ©f the world. I have also presented, 
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defended, and illustrated the application of a sot of principles for judging 

♦ v. 

the reliability of observation statements. The principles deal with influ- 
ences on reliability which come from three different sources: the observer, 
the ob^rvation conditions, and the observation statement. I have urged 
throughout the paper that the principles must be applied with judgment 
and flexibility • 

While many of the principles may seem to be truisims, having the list 



explicitly ' presented is advantageous in several ways v In the first place", 
for a person who is well , versed in the principles and their application 
factors which reduce the reliability of observation statements in particular 
cases* will tend to stand out* Also, such a person might be able to ex- 
press his or her reasons for thinking a statement is unreliable in a situa- 
tion where that person would not have been able to so had he or she 
not been familiar with the principles in their explicit form.-* 

Second, in unfamiliar* situations it is not as likelythat factors affect- 
ing the reliability of observation statements will be as readily apparent as 
they would be in more familiar situations. The list of principles can serve 
asj a guide in such situations for making judgments of reliability. The 
principles can be usqd to suggest the questions that should be asked in 
evaluating reliability. 

Third, the list of principles can serve as guides to practice in devis- 
ing procedures to enhaYice reliability. If one is in a situation where many 
reliable observations musjt be made, the principles can indicate the sources 
of unreliability which must be taken into account. The principles can 
point to places where safeguards must be built into the observation pro- 
cedures. 




Finally, the list of principles can be useful pedagoglcally . _The list 
can be used as a curriculum outlirie for a course designedto teach stu- 
dents about factors which affect the reliability q( observation statements. 
Or, the list can be used to suggest places where discussions of reliability 
of observation statements might fit easily and appropriately into existing 
courses, such ^as science or history. ~^In addition, the list can serve as 
the basis for tests which evaluate students 1 ability to detect factors affect- 
ing the reliability of observation statements and their ability to judge the 
influence of these factors on the reliability. Whereas many tests of think- 
ing abilities are built upon undefined notions of what is being ^tested, ■ 
these principles provide a reasonably detailed list which could be the basis 
for the construct validity of a test. x 

Knowing how to judge the reliability of observation statements is an 
important critical thinking skilj. Maybe this list of principles arid its ex- 
planation and defence will be helpful in fostering these important skills in* 

r* 

our students. 
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NOTES 



I. I wrote this paper assuming that people from many fields might read 
IV" One reason for. writing the paper is to* provide the theoretical 
support for a test designed to assess peoples' ability to judge the 
reliability of observation statements. Since science educators, school 
board supervisors, teachers* testing experts, and philosophers, 
among others, would probably be interested in a test of this sort, 
this paper will probably reach a diverse audience. It is likely that 
each reader will find some things in this paper trivial and other 
things very complex, since I was attempting to satisfy so many 
groups. 1 a Pgl°.gl_¥L _t©_Q!y readers for this and ask t hem to_try_t o- 
bear \^|h my work. 

'* Despite the influence that eyewitness testimony can have in a trial, 
Wigmore ( 1935) has emphasized that there is no rule requiring eve- 
witness .proof (p. 309), nor is there any rule which says that such 
proof has a special preference (p. 231). To further support this 
latter point, Wigmore cites several cases in which circumstantial evi- 
dence was used to overthrow the testimony of eyewitnesses (Sec. 20). 
But, as Wigmore attests,- testimony of eyewitnesses is an important 
source of evidence. ' >- — 

. Many science textbooks, for example the BSCS biology text (1963), 
stress the importance of observation in science. The BSCS book tells 
students that: "In his own special field of work, each scientist bases 
his beliefs on his own careful observations, checked and confirmed by 
the observations of others. Skill in observing is, then, a basic 
requirement of science." (p. 5) Although tHis passage might lead 
students to tf^ misconception that a scienttsNhas his own obser- 
vational support for everything that he o^lieWis, it does correctly 
point out the importance and function of observation in science. 

. My thinking in this area has been influenced) to a great deal by the 
following work: Quioe ( 1960, esp. p. 42-45/, Quine (1969, esp. p. 

• 84-90), Quine and Ullian (1970, 6h.'2), Qu(ne and Ullian (.1978. Ch. 

• 3), and Ennis (1969, esp.- p. 384-388). QunTex and Ullian have, modi- 
tied their doctrine in the second edition of their book. The vi$w I 
present is more in line with their first edition doctrine. In that first 
doctrine they allowed the" distinguishing of observation statemerrts- 

• from other statements to be done relative to the field of knowledge 
and community of speakers within which the statements were made. 
Thus a statement might be an observation statement for one group of 
speakers and not for another. In their second edition they do not 
allow this relativism. 

.,- • 

I believe our ability tp recognize observation statements is superior to 
our ability # to poinFTo the features of those statements which we fuse 
to recognize them as such. Thus, in my attempt to distinguish 
features of observation statements, I first identified on the basis of 
my intuitive judgment statements which I considered to be observation 
8tat * ITH * nt *L: 1 then examined these statements for features Which 
could be Sised to distinguish them from other types of statements. 

Sn 
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I believe the characteristics which I identify are characteristics which 
any statement muat have to br an observation statement . However , \ 
do not believe that a Statement's having any one or any combination 
of the characteristics is*a sufficient condition for saying that that 
statement is an observation statement. 

There is a view in philosophy which holds that observation statements 
can be distinguished from other statements by merely looking at the 
sentences (that is, the actual words) used to make those statements. 
The view depends upon assu ming t hat the non -logical vocabulary o f 
language can be divided into t wo parts : observation te rms and 
theoretical terms. (The logical vocabulary incl udes the following 
words among others : 'if f , 'and', 'or 1 , ' but 1 , 'only ' . ) Observation 

s tatements on t hi s vie w are those staternon t s contalnin g _ _oj \ l_y_ _o bs er v a^ 

tion terms and logical words. Theoretical statements are statements 
containing theoretical terms. This view has been shown incorrect, I 
believe, by Putnam (1962) and by Achinstein ( 1 965 and 1968). Their 
arguments rest partly on showing that observational terms can be dis- 
tinguished from theoretic al te rms dnly by considering the context in 
which the terms were used. When one considers context,; then it can 
be shown that the same words can be theoretical in some contexts and 
observational in others. 

I hold a similar view to that of Putnam and Achinstein . I also 
believe that observation st^terHents can toe identified as such only 
after taking into account features of the situation in which the state- 
ments were made. I do not believe that an observation statetrtent can. 
be identified as such merely by looking at thu words that were used 
to make it. However, the words themselves can or cannot make one 
suspect that a. statement made using them is an observation statement. 
Certain forms of words arc more likely candidates than others to have 
been used to make an observation statement. Characteristic B picks 
out one such form of words. 

Robert Monk ( 1978) has argued, convincingly I find, that scientific 
observation need not involve the use of human senses at all. Some 
observations xould be made, Monk claims, completely by machine, once 
they are set up and turned on. Even the observation statement 
itself, the report of the observation, could be made by the machine. 
That is, the machine could be programmed to control a typewriter' or 
other printing or recording device.. 

There has been a Ion g history of foundation ali sm in philosoph y . 
Foundationalism is a yiew which holds that our knowledge is made up ■ 
of statements which form sort of a structure with some of the stat>e- 
-ments relying upon some of the others for their support. ^ The 
analogy with the structure of a building is appropriate. The struc- 
ture of our knowledge might consist of various "levels" of statements, 
as a building might consist of various levels . Those sup porting 
different views of foundationalism maintain that our knowledge is 
composed of different numbers of levels. There is much disagreement 
on this point . There is ag reement among foundational ists that some 
statements in the structure must not rest on other statements. Those 
Statements are the foundations. They must get their support from 
sources other than other ' statements or else they must be seJf- 
supporting. For various classical works on foundationalism one might 

■ • 
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see the following, all of which "are technical: Austin (1964), Ayer 
(1952, esp 7 p. 5-26) , Lewis ( 1946, esp, Ch, 8 & 9), and Chisholm 
and Swart* (1973, esp. Ch, 5), 

The view I present in this paper is foundationalist in that I 
believe that observation statements are used as the basic support of 
many Inferences based upon them. However, I depart from many of 
the foundationalists Itn thfot I do not believe that observation state- 
ments are infallible \or do I believe that the lines of support always 
go from the observation statements to the inferences* based upon 
them f I believe that inferences can be used both to support and to 
overthrow observation statements, although this is not the usual state 
of affairs. However, in times when all the theoretical (inferential) 
knowledge we have good reason to believe leads us to think that -a 

— reported-observation— ought— not— to-have-been-ob served ,-^t hen-sueh- an- 

obser vat ion statement becomes suspect and is sometimes rejected on 
the basis of the theoretical knowledge,, 

10, The statement of this characteristic may seem circular to some because 
of the restrict ive clause M who have made the same observation" , It 
may seem circular because characteristic E is intended to be helpful 
to people in picking out observation statements, but to b/? able to use 
the characteristic one must first decide that people have made the 
same observation, But one of the best ways to decide whether people 
have made the same observation is to examine the observation state- 
ments they make to see if the statements are the same. To do this, 
one has first to identify which of the peoples' statements are observa- 
tion statements. But this latter task is one for which the character- 
istic, was designed. Hence, the circle. 

The statement of characteristic K would not be circular if one 
could decide that people haye made the same observation without 
examining the observation statements they make, I believe that this 
can be done. One can decide that people have made the same obser- 
vation even if those people do not make any report of their observa- 
tion in a statement. Other evidence that -people have made the same 
observation can be gained. For example, if two people are facing the 
same direction, and both cover their eyes when a blinding light 
flashes in front of them, one could justifiably conclude that those two 
people have made the same observation. That is, evidence from the 
situation , other than what the observers report , can bd| used to 
decide whether the people have made the same observation. In the 
x above example, the evidence from the situation wa<5 the following two 
things: both people were facing in the same direction, an% both 
covered their eyes after the blinding light flashed, 

11, I say "in most cases" becalise there are situations in which. a state- 
ment can be rrwre- reliable than the statements upon which it is based, 
I consider an example of this, the voting example, near the beginning 
of the next section . However, I will give another example here. 
Suppose a person counted the number of growth rings in the cross 
sections of two trees. Suppose , having finished the counting, the 
person made the following three statements, basing the third on the 
first two: "Tree A has 45 growth rings"; "Tree B has 150 growth 
rings" ; "Tree B is older than tree A" , I believe that the third 
statement is more reliable than the first two statements, even though 
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it is based upon them. I beli-ve this because I know it is very easy 
for a person to miscount, by a small number, the growth rings on a 
tree, but that it is very unlikely that k person's miscounting could 
account for the large difference report/d in the first two statements. 
Hence, while it is likely that the first two statements are in error by 
a small amount, it is unlikely that they are in error by as much as 
the difference between the two counts. So, even if the first two 
statements were found incorrect and corrected, the statement based 
upon the revised statements would likely be the same as the third 
statement is now. Hence, the third statement is more reliable than the 
first two. 

The list of principles I give are. based uporii the list given by Knnis 
— (- 1-96 2-)— a n d— eon- ve r s at io ns— wit h hi m~ "a n"d — o the r — rYre"m'b"e~r"S "of - t'lTe - II 11 riois 
Rational Thinking Project. The main differences between Knnis' list 
and my list are: (i) I have included principles applying explicitly to 
observations made using instruments; (ii) I have added some prin- • 
ciples dealing with the nature of the observation statement; and (iii) 
I have made changes and additions in the list of principles dealing 
with records of observations. 
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